Execute test case
Execute case
Submit result
Basic
Case type : Case ID :
Case name : Category folder :
Version : Execution type :
Keyword : Status :
Auto type :
Workloading : (Min) OS :
Priority : Phase :
Creator : Owner :
Objective :
The case is for Win11 Preload test,Test on CN&EN,Include Preload,OOBE,Default settings,drivers & APPs version check and uninstallation/installation, recovery,system Basic function…Must execute when require to test the Preload.It is required to execute the Preload test case from the beginning of the FVT to the entire life cycle. In the FVT stage, the Preload test case can be executed in the later stage of the FVT. This case is released for Notebook!
Release notes :

[2025.8.28]
1. Add check item "Lenovo Responsible AI Policy" in "Default Settings" section
2. Add 25H2 diskpartition SPEC

Type matrix :
Case tools : Download Case Tools
Attachment :
System info_NW.png
PLA002_D37_Registry Value in CN Preload.JPG
PLA002_D54_WLAN display.jpg
PLA002_D55_WLan Network selection.jpg
OOBE check point for Russia image.jpg
WinSpy SOP.docx
Partition list in diskpart tool.png
Yandex browser default homepage check steps20220822.docx
Modules_in_TestModule.jpg
NDUP Check for updates.png
NDUP update process.png
FY2223 New products wallpaper matrix 20240719.xlsx
LNB FY2324 NPI products wallpaper matrix v0.8 20240719.xlsx
LNB GenX NPI wallpaper matrix v0.7.xlsx
PLA002_D12_CPP2 Partition list V016.5.xlsx
PLA002_D12_CPP2 Partition list V20.0.1.xlsx
PLA002_D12_CPP2 Partition list V016.4(20211108).xlsx
PLA002_D12_CPP2 Partition list V017.0.3.xlsx
PLA002_D12_CPP2 Partition list V19.0.2.xlsx

NA Not support Block On going Not start Pass Fail Total
0 0 0 0 2568 0 0 2568

     Comments :

*Note: How to batch set test result?Click here
A7N1625S01 A7N3225S02 A7N3225S03 A9N1625S04 A9N3225S05 A9N6425S06
    Test case item Expected result
 
Section : Preparation (180) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Cover Win11 CN&EN preload test.

Please according to step descriptions to dertermine use which account (local or MS) to test.

If the project has OLED panel, you need to cover this config.

1. Review Config List and Keypart List for the Project.Preload test should cover all devices which need install driver base on driver list,Change each configuration when necessary.

2. Highlight: Need to cover the minimal disk(especially for the space of SSD/EMMC is no more than 64GB). Need to choose Minimal disk with Maximal RAM config for CN image preload test. Need to cover all disk combination configuration of the project (such as the project support SSD only,SSD+HDD, both need to be covered )
3. Flash latest Bios,load default setting,save and quit.

4. Before test,please confirm your preload edition?

5. Before Preload,You need to check your product name has showed correct in the Bios Setup interface.
If no,please check with your BIOS team.

6. Cover Win11 S Preload test.(For S mode preload,Please make sure the “CloudDebug0” Module has been at the Preload guide interface. )

Note:
Since Win11 22H2, if you want skip mandatory connect internet step, there're two methods as below:
1. During OOBE process any interface, press Shift+Fn+F10 to call CMD window.
    Input "cd OOBE" Enter
    Input "bypassNRO.cmd" Enter, then unit will restart.


For home version OS, you should execute "bypassNRO" before select "language". Since home's design only allow select "language" and "region/country" items once. Next time select other "language", "region/country" UI will prompt error.


2. Before preload, check with preload team and obtain the module name of which could skip OOBE.
In preload guide, manual select this module to left, then start preload.
After finished preload, it will auto boot to desktop. For some no need to check OOBE process tests, you can select this method.


From 24H2 6D, if you couldn't use above method to avoid connect to internet during OOBE, you could manual add module "W11JC002B" in preload to test steps which need never connect to internet.

Test Guidance
1. Test sections/steps could follow background color marking to execute:
    Yellow background should test without internet;
    Green background need test with internet;
    Orange background need login with MS account;
    Unmarked sections haven't network requirement.


2. "MS OOBE(EULA)" section only use MS account to test.


3. Tester should prepare preload image quartic at least.
    a) One is use MS account login to test "MS OOBE(EULA)" section and orange background marked step. Then follow case sequence, open SAC and disconected to test "Installation & Unistallation" section.
    b) The second is use local account login and test the steps which needn't internet from "Start Menu Check" section to "Hot key" section firstly. Please test in order.
Secondly, after finished above test, execute from steps which need connected internet to the end.
From "PBR" section, test whether need internet please follow prompt.
    c) Prepare two units and log in to them with local account and MS account to test "Lag & System Resource Utilization Check" section respectively(Detail test steps, please refer the section Notes).
    d) Finally, prepare an unit that is not connected to internet during OOBE stage to test "1h quiet time test" section. Please execute this test as soon as OOBE is completed.


Note:
1. Use MS account to test, please clear account sync info firstly.
Open Microsoft account, click "Devices">"Cloud synced settings">"Clear stored settings", then click "Clear" button.


2. If your project support "RTP", please prepare enough units to preload. If there's Root Deliverable "WinB-EnterprisePreloadTrigger" in your SWlist, check its module name and add it manually while preload.

Notice:
1. For different OS/APP Version, the location of some functions maybe different. You can operate with the guidance, search it in search bar or contact with related team.
2. For launch apps, if need connect internet, please follow prompt message(if has).

Note: All the tools needed in this case could be downloaded from the link above the case.

 
Section : Preload (60) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Applicable to Lenovo Preload,No Error POP,No Quit Execution,No System hang or halt,No Operator's interruption,during MOPS AUDIT.

Note:If you download S mode Preload, need to disable secure boot and then preload system.Add please add the “CloudDebug0” Module, otherwise you can't run any tools in the following test.

1. Plug LAN cable in.
2. Boot from PXE.
3. Preload Guide shows up.

4. Select Product, Preload Version, OS Type, Base, Edition, Language and so on.

5. After selection, please ensure there're no two modules "Test mode and dump setting" & "Generate APP DUMP" in "TestModule" list.
If not, remove them(refer to attachment "Modules_in_TestModule.jpg").

6. Click "submit" then start to preload.

Make sure preload process without any errors.

 
Section : MS OOBE(EULA) (60) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note: Not all the OOBE interface will be listed in the following.
For more explanation, please refer to the website: Customize the Out of Box experience (OOBE) | Microsoft Learn

Follow the guidance to finish OOBE, make sure that there are no exceptions in each step of OOBE, such as page switching will have a long delay, garbled, etc.
Ensure the whole OOBE procedure has no abnormal voice output.

1.The Basic interface you need to choose,Including "region"/Keyboard Layout"/"add a second keyboard layout".
And during these pages, do following steps.

1.1 Press Win+Ctrl+Enter to call the Narrator

Ensure Narrator could work.

1.2 Click Accessibility icon to open its menu, open Magnifier then move the cursor and adjust percentage of zoom in and out.

Ensure the magnifier function is ok.

2. Choose a wireless network and then click "Connect".(this step just appear when wireless card is enabled),Input password and connect.


Note:Only need cover MS account login.

3. Click "Accept" in the License agreement page.

Lenovo license agreement in the right box(For some language it maybe in the left box). And the display language need consistent with current selected language.

4. Input the user name for the account interface,and then input the password (if no need password, can be null).


Note: Tester need to cover logging in with local account and MS account for CN&EN system.
For login with MS account, there maybe other additional pages in the process. Anyway, follow the instructions step by step until finished it, it's ok.

5. Choose "Accept" in the services interface,"Choose Privacy settings for your device".

6. Show the interface "Protect your device",Choose "next".

6.1 You need to check the default settings correct or not.
OOBE check box SPEC please refer to following address:
https://confluence.tc.lenovo.com/display/PD/0.+OOBE+Customization+-+General+Design


Note: Any question please confirm with SWPM or SPEC owner.

7. For WOA project,  when connect with internet, please ensure there're NDUP UIs in the OOBE process(refer to attachment "NDUP Check for updates.png" & "NDUP update process.png").

8. Make sure no unexpected restart after OOBE, and then disconnect the internet.

9. Open C:\Windows, check if only a date in CSUP.txt with the format "MM-DD-YYYY".
And the date is no later than current preload date.

 
Section : Start Menu Check (180) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note: Please test this section by local account without internet and completed it within 15 minutes after OOBE.

For test this section, according to the layout spec address: https://confluence.tc.lenovo.com/display/PD/WinOct2021+Layout+Spec, Please check with the project SWPM/SEPM,which model does your project belongs to(such as:Consumer NB Normal or others)?



Note: If you click “https://confluence.tc.lenovo.com/display/PD/WinOct2021+Layout+Spec" hyperlink, don't see the layout spec. please contact SWPM for this spec.

1. Start menu check

1.1 Start menu layout check

1.2 Ensure that all necessary OEM applications are installed on the start menu.

1.3 Make sure the number of OEM pinned applications or websites on the first page of the "Pinned" section of the start menu is no more than 4.

1.4 Make sure the number of OEM pinned additional applications or websites on the end of the last page of the "Pinned" section of the start menu is no more than 4.

1.5 Make sure the number of OEM pinned application or website on the recommended section of the start menu is no more than 1.

2. Taskbar check

2.1 (For all SKUs)Taskbar icon numbers: The apps(Not including MS Programs icon) is no more than 3 icons(≤3icons) pins to the taskbar.

2.2 Make sure OEM has not pinned or promoted any applications in the Systray area of the Taskbar.


Notes:
1. OEMs must not show additional application icons in the Taskbar corner area of the Taskbar. This position we called "Systray".
2. OEMs may include additianal application icons in the Taskbar corner overflow. And this we called "Systray overflow area".

2.3 Make sure OEM has not enabled toolbars or deskbands on the taskbar.

2.4 Ensure that all the required lenovo icons are listed on the task bar.

3. Shortcut

3.1 Make sure there is no extra desktop App icons on the desktop expect the recycle bin,Microsoft Edge.

 
Section : Smart APP Control test (60) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note:
1. S mode no need to execute this test.
2. Execute this test on unit which has been logging with local account and never connected to the internet.
3. Before executing this section, do not install any drivers or apps manually.
4. This test need cover all drivers and apps.

1. Download the latest SACVT Tool and copy it to test units.

2. Execute the SACVT.exe as administrator. 

3. The tool will create a zip file in the .\Results directory. This zip file will contain an HTML report of the test results, as well as a child folder containing collateral log files from the tool execution.


Important: It is not possible for a tool to scan a Windows image and determine with complete certainty that all files are properly signed. This is because executables can be embedded within other files or loaded from external sources. (From “MDA Smart App Control Validation Toolkit Guidance” Version 2023.02.01.0 RTM)

The Results folder should not show fail.
If pass, upload the zip file(pass log) in result folder to TDMS(must upload).
And if there's fail items exist, record related items.

4. Verification stage


For the failed results of run SACVT tool, you should use follow steps to verify these issues.

4.1 Close Windows Update.

4.1.1 Open services.msc, stop "Windows Update"

4.1.2 Double click "Windows Update" and set "startup type" to "Disable"

4.1.3 Switch to "Recovery" label, set "First failure" to "Take No Action"

4.2 Connect to internet at least 30minutes

4.3 Execute SACVT tool again

4.4 Check whether there are failed items in the result file and compare it with which you recorded in step 3. Then create issue on TDMS.
Notice: 1. For SAC problem please create severity 2 issue on TDMS. It will be gating shipment.

4.4.1 If the failed items recorded in step 3 are already passed or have new fail items in current results file.

Create issue and upload fail log as attachment on TDMS,  assign to SWPM.

4.4.2 If fail items are the same with step 3.

Create issue and upload fail log as attachment on TDMS,  assign to related owner.

 
Section : APP&Drivers UI Check (720) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note:
1. For checking the app and driver version, please skip mandatory connect internet step of OOBE.
2. For launch apps, if need connect internet, please follow prompt message(if has)

1. Launch all applications from each path at a time(including "desktop","system tray","Start menu","All apps").


Note: If your project support "Copilot key", must launch Copilot by "Copilot key".


For project which support copilot key, could refer following Market Availability to confirm which country/region support copilot.
Copilot Market Availability
- Not available in China, Russia, Belarus, Cuba, Iran, North Korea, Crimea

The target Application/Utility should be launched from all path. Make sure all the applications can be launched at a time and the main UI has no error or truncation.


For supported country/region, press Copilot key will launch "Copilot", otherwise will launch "Windows search"

1.1 Since X90 generation projects, if there's "xxxxx UG link" module in swlist(xxxxx means product name), lauch User Guide from every path(including "Pinned", "All apps").



Note: For the column width in SPMS swlist is not enough to display the UG link module name, you can press "Fn+F" and fill the full module name in query box, then check the serach result is 1.

For CN, make sure the opened web url is: https://iknow.lenovo.com.cn/detail/xxxxxx
"xxxxxx" is a 6-digit number. Please confirm with SWPM which 6-digit corresponds to the your project.


For EN, make sure the official Lenovo Support Website is opened and the product name in the web URL is correct: https://support.lenovo.com/docs/project name


Note: For NPI project, the UG release schedule is SS+2weeks. Before this time, when you launched UG with internet connected, it is normal to see nothing but a warning on the webpage “The resource is moved or not available at this moment”. You could verify whether the URL is correct by disconnect internet.

1.2 From 24H2, for supported image, need launch "MS PCmanager" and "teams"

MS PCmanager and teams could launched normally.

2. Following the requirement in the SW list,Check all the APP preinstalled or not,and check applications' version is right or not.(For Metro Apps' check, you need to open the metro app and then check the app's version)

All required APP preinstall and no unrequired APP preinstall on the preload image.The version should be the same as defined in SW List.

3. MEP Version check


If there's MEP related package in SWlist-OS(Special) Information area, you should check whether its version is consistent with "Windows Studio Effects Driver" or "Windows Studio Effects Camera" in "DM-Software components".

4. LLW file check, the LLW file was combined in Lenovo Vantage for ROW.
Check the LLW file, the path maybe as below:
Lanuch Lenovo Vantage-> Click icon at the upper right of the main page-> Click "About lenovo vantage"->Click "License agreement"->Click "Lenovo limited warranty"


Note:
1. Lenovo Vantage version before 2405 only support online LLW. Please follow your version check all supported methods.
2. For the software UI change, the detail check path maybe different with case description. Any doubt for this, please contact with Lenovo Vantage team.

Make sure you can open the LLW file for the corresponding language

5. For Win11 S Preload, Make sure no driver utility UI/Settings interface(Except intel VGA driver), such as Audio/Touchpad UI.

6. For the project that support Eink, Close the lid and switch to Eink interface. Ensure main UI no error or truncation. Ensure Eink interface displays the same languge as the corresponding OS.

7. Disconnect from the internet, the User guide will be combined in Vantage for ROW,For ROW,Launch Lenovo Vantage->Support->User Guide, confirm the user guide can be launched successfully and user guide document can be opened.


Note:
For ROW, since X40 generation project, you also need to check the online User guide.
1.Connect to the internet.
2.Launch Lenovo Vantage->Support->User Guide.
3.Make sure the model name and language are correct.


For CN,you can check offline User Guide in C:\ProgramData\Lenovo\UserGuide\UserGuide_html\html_zh-CHS.


And online User Guide, launch PCM->Main Menu->User Guide, ensure https://newsupport.lenovo.com.cn/ will be opened(Only confirm this websit can be opened correctly).

Make sure user guide document can be opened successfully and the language is correctly.

8. Launch MS software(Such as Office,Skype),Make sure no errors.

9. Open the Device manager,check the drivers.

No unnecessary marks (yellow marks , red marks ,etc)

10. Check Driver version according to SW List.

The versions should be the same as defined in SW List.

11. Driver utility UI Verify,ensure main UI no error or truncation.

12. Check "D partition" Or "C partition"(Check the Backup Partition).

There's "drivers" folder in the backup partition.


For S mode preload, make sure no driver backup folder in all disk.

13. Check "drivers" folder.

All drivers must be copied into this folder.  No unwanted drivers are copied. And There should be clear executable file in every driver's folder. 


For S mode preload, make sure no driver backup folder in all disk.

14. Open Control Panel(View by:Category) -> Uninstall a program -> View installed updates. Check the SW list and make sure all KB in SW List are installed.


Note:If there is no KB in SWlist, there is no need to check. The KB info in SWlist contains in OS(Special) Information/ZDP detail info.

15. Open Control Panel-> Programs-> Programs and Fetures, check Currently installed programs.

Ensure there're no program of Chinese characters in it excepte CN image.

16. Connect to the Internet and waiting for a while. Make sure there are no any new OEM shortcuts pinned to the desktop, taskbar, or Start menu.

This is OPD requirement. OEM preinstalled apps must not pin new shortcuts to the desktop, taskbar, or Start menu without user consent.


Any doubt confirm with SWPM.

17. Virus scan: Use antivirus software which preinstall on DUT(EN:McAfee, CN:PCM) to scan the system,make sure no errors.

18. Make sure you can log in the store with your Microsoft account and can install Apps.

 
Section : Default Settings (300) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note: Execute this test on unit which has been logging with local account and never connected to the internet.

1. Wallpaper check

1.1 Check your project's default wallpaper
Please follow your project's generations refer corresponding attchment at the top of the case.
The names of SPEC for reference are as follows:
"FY2223 New products wallpaper matrix 20240719.xlsx"
"LNB FY2324 NPI products wallpaper matrix v0.8 20240719.xlsx"
"LNB GenX NPI wallpaper matrix v0.7.xlsx"


Note: Any discrepancy with the SPEC or doubts, comfirm with SWPM, please

For 24H2, wallpaper is static. Confirm current wallpaper is consistent with SPEC.

1.2 Display mode check
Please refer to the appropriate SPEC file, "wallpaper Sample" sheet->"Rule"/"Wallpaper display mode" column to check whether it's dark mode.


Note: Any doubt contact SWPM, please.

Dark mode check as following:
Open Settings->Personalization->Colors->Choose your mode, ensure the selected mode is "Dark".

2. Disk partition and size check

Make sure all disk partitions are correct and no empty partition.

2.1 Different storage combine schemes have different disk partition strategy, all schemes need to meet partition SPEC. 


 Check the partition detail info, you could use diskpart tool in cmd with administrator account.

Before 25H2:
For SMB:
From 2024 NPI's projects, refer to "PLA002_D12_CPP2 Partition list V19.0.2.xlsx", before 2024 NPI's projects still refer to "PLA002_D12_CPP2 Partition list V016.4(20211108).xlsx".
If couldn't ensure whether your project is 2024 NPI's project, confirm with SWPM.
For consumer:
Please check module "Win11_2021 Create Volume D"/"WinS_2021 Create Volume D"/"WinSE_2021 Create Volume D" version in your SWlist to pick up related SPEC.
V1.1, refer to "PLA002_D12_CPP2 Partition list V017.0.3.xlsx".
V1.3, refer to "PLA002_D12_CPP2 Partition list V19.0.2.xlsx".
For WOA projects:
Please refer to "PLA002_D12_CPP2 Partition list V19.0.2.xlsx".


From 25H2:
For SMB:
Before 2024 NPI's projects still refer to "PLA002_D12_CPP2 Partition list V016.5.xlsx", other projects refer to "PLA002_D12_CPP2 Partition list V20.0.1.xlsx"
If couldn't ensure whether your project is 2024 NPI's project, confirm with SWPM.
For consumer & WOA:
Please refer to "PLA002_D12_CPP2 Partition list V20.0.1.xlsx".


Detail partition info example refer to "Partition list in diskpart tool.png".


Note:
1. For dual SSD non RAID0 mode CN region, SSD2 MSR disk partition size both 15M and 16M are all pass.
2. For UFS disk SPEC, please follow SSD

2.2 Check the free disk space of the disk C. Run cmd as administrator,execute command:
cd c:\recovery\customizations
dir
Check the size of the USMT.PPKG

For normal project,the free space of disk C at least 4GB + Size of PPKG * 2

2.3 For all system,must meet at least 10 GB free disk space of the disk C.

3. Run the tool "DCVT"


Note:
Please after OOBE one hour and reboot unit, then run this tool.
If the manual run the test as soon after OOBE, then we will get the failure of “Verify the file and protocol associations fail”. We should to avoid the issue.

For check MS JS requirement.

3.1 Unzip the package to the test system or a USB drive

3.2 Double click DCVT.exe and observe the results folder. Notes:For systems that are to be distributed within the People’s Republic of China (excluding Hong Kong and Macau), run the following command: DCVT.exe /China

Make sure DCVT result folder don't show fail.


Attention:
Please be aware that Kaspersky v21.3.10.391k (currently the latest version) can’t be shipped in 24H2 due to the version is lower than the version be approved by MS.
The miniumum approved version of Kaspersky is 21.8.5.452.

4. Check "Display resolution"

"Resolution" should be set to the highest value.

4.1 Change the resolution and then apply.

Make sure no errors occur.

5. If the project has added lenovo screensaver, check the screen saver no error.(If no Lenovo screensaver, Skip the steps).Right click the desktop->Personalize->Lock Screen->Screen saver settings,Choose the lenovo screensaver and then apply,make sure no errors. 


Note:
If Windows is inactivate, you can use the follow method to set screensaver.
Open cmd and type in "control desk.cpl,,@screensaver", then set screensaver as Lenovo screensaver.

6. Theme switch check

6.1 Open Settings-> Personalzation-> Select a theme to apply(Don't maximize the window).

6.2 Switch the theme at least 10 times.

Ensure the screen have no flick, jitter or other abnormal(especial when switch to dark theme).

7. Click "Task manager"->"Performance",Launch several APPs.

Ensure no extra high CPU and Memory usage

8. Click Settings-> System->About,the PC model name is displayed.

Refer to the "System info_NW.JPG".
Note:
1. If PC model name does not match your test device, please contact with TPM/SWPM.
2. Commerial project please skip.

9. Make sure the number of browser favourites in Edge is no more than 5. 

10. Check two values in registry. Click Win+R->regedit-> "HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Store"

Check the correct value 'OEMID' is LENOVO.
For AMD64 architecture, the value of 'StoreContentModifier' is "Lenovo3_Idea"
For ARM64 architecture, the value of 'StoreContentModifier' is "LENOVO9_ARM64PC"

11. Basic function test of some apps for assistive technology device

11.1 Narrator
Press Win+Ctrl+Enter to call the Narrator then launch File Explorer, Edge and move the cursor to start menu, task bar

Ensure narrator could work.

11.2 Magnifier
Type in "Magnifier" in search and launch it then move the cursor and adjust percentage of zoom in and out.

Ensure the magnifier function is ok.

12. For CN Preload,Check the value in registry. HKEY_LOCAL_MACHINE\SYSTEM\Maps ‘OEMChinaVariantWin10’ value is 1

Refer to the "PLA002_D37_Registry Value in CN Preload.JPG"

13. For project with WWAN module,CN image, need check following items:

13.1 Need to agree to the following spec: Click Wifi icon->Network settings->Wlan,the wireless display string must be Wlan(Or display in chinese) in the connections.

Note:In China, WWAN mode,According to MIIT's rule, we must use the term of "WLAN" (or display in chinese) instead of "Wi-Fi" for the OS. Refer to the " PLA002_D54_WLAN display.jpg".

13.2 Plug in your SIM Card or USIM Card in the WWAN card port,(recommend to use the Telecom SIM card),Click the Wifi icon->Network settings-> Mobile network->Click "Advanced option" and then search Network,make sure can auto search the others WWAN signal(Such as Telecom can search mobile & Unicom)

Refer to the "PLA002_D55_WLan Network selection.jpg".

14. Make sure that the Operator Messages and Mobile Plan apps are only installed on devices which include embedded mobile broadband.

15. Check Logo(WHQL check) (Execute this test from GM0 preload image)


Note:Please download related tool to test.

Note:Before reporting the bug, please confirm the test result with the HLK tester, and the HLK test result shall prevail.

15.1 Type cmd and run as administrator and type the below command: C:\DriverAssessment.exe /checklogo

If passed,There is no display in checkCertification_failed.txt If Fail, please Paste the checkCertification_failedlist.txt


Note:Before reporting the bug, please confirm the test result with the HLK tester, and the HLK test result shall prevail.

15.2 Check the NoMatches.txt in the folder,Please confirm there isn't any no-match devices.

Note:Before reporting the bug, please confirm the test result with the HLK tester, and the HLK test result shall prevail.

16. Check the apps, make sure no app have the function similar to start menu or like a shortcut can link to other apps.


Note: Apps that launch other apps using protocols or file handlers are not restricted.

17. MDAVT Tool (Please make sure the result of Smbios-chk tool is passed before test this item,if the result of Smbios-chk tool is failed,you need open the issue of “MDAVT TOOL test is blocked by SMbios test result failed ” to TDMS)

17.1 Run the tool "MDAVT", connect to the internet and execute MDAVT.exe from either Explorer or an Administrator command prompt.

If execution was successful, the tool will create a zip file in the .\Results directory where MDAVT.exe was launched from. This zip file will contain an HTML report of the test results, as well as a child folder containing collateral log files from the tool execution.

17.2 After finished "MDAVT" running, run chkmda.exe
Running chkmda.exe tool in PowerShell/CMD as administrator.
Review the result, if any fail, save the log manually.
You can create a txt file, put the cursor in the CMD, press Ctrl+A, Ctrl+C, return to txt file, then press Ctrl+V, save it.

Make sure the result should be passed both MDAVT.exe and chkmda.exe. No fail item to be shown.

18. If there is "Power Plan for FN+Q 4.0" module in Swlist, you need to execute follow steps. Otherwise, skip it.

18.1 For CN image, open power option,there should have four power plan: “平衡”,“安静模式","均衡模式","野兽模式",make sure the default power plan is "均衡模式". For EN image, open power option, there should have four power plan: "Balanced", "Legion Performance Mode","Legion Balance Mode","Legion Quiet Mode", make sure the default power plan is "Legion Balance Mode".

Ensure that the displayed language matches the current system language.

18.2 Use the FN+Q key combination to switch the three modes.

Make sure that the FN+Q adjustment mode is synchronized with the power plan mode.

18.3 Change power plan to "Balanced" or "平衡", then click the “Change plan settings” of "安静模式"/"均衡模式"/"野兽模式" or "Legion Performance Mode","Legion Balance Mode","Legion Quiet Mode", click "Delete power plan".

Make sure that the three power plans can be deleted normally and the displayed language matches the current system language.

18.4 Open C:\drivers\LegionPowePlan or D:\drivers\LegionPowePlan, double click setup.cmd.

Make sure that the three power plans can be installed normally and the displayed language matches the current system language.

18.5 Change power plan to "安静模式"/"Legion Quiet Mode" on DC mode, Make sure the battery icon on the task bar show battery saver and the battery saver in the notification center is turned on.

19. For CN image, check if there's Root Deliverable name "LOL MiniLoader" in SWlist

19.1 If there's Root Deliverable name: "LOL MiniLoader" in SWlist, check if "WeGameMiniLoader.exe" file in path "C:\Program File(x86)\Tencent\LOLMiniLoader"

"WeGameMiniLoader.exe" file should in path "C:\Program File(x86)\Tencent\LOLMiniLoader"

20.  For EN image, from 24H2 check if "Quick Setting APP Link" module function is ok.

20.1 Click icon group of "WIFI, audio, battery" on task bar to open "Quick Setting" panel

Ensure there's Vantage icon in bottom right cover of "Quick Setting" panel.

20.2 Click Vantage icon

Ensure Lenovo Vantage could launched normally.

21. From 25H2, check "Lenovo Responsible AI Policy" in start menu

21.1 For CN image, click start menu-All-"联想人工智能(AI)政策"

Ensure related PDF file could be opened correctly.

21.2 For EN image, connect to internet then click start menu-All-"Lenovo Responsible AI Policy"

Ensure related file could be opened correctly.

22. For X80 generation projects CN image, OS build before Win11 24H2 check "VBS"(Virtualization-Based Security) default setting

Ensure it is disable. Need confirm both Memory integrity and VMP are disable. 

22.1 Memory integrity default setting check
Navigate to Setting->Privacy & security->Windows Security->Device security->select "core isolation details" under Core isolation, ensure default "Memory integrity" status is Off.

22.2 VMP default setting check
Navigate to Control Panel->Programs->Programs and features->Turn Windows features on or off, ensure default "Virtual Machine Platform" status is uncheck.

23. Security requirements test
Note:
1. All model from Win11 22H2 need support L2 security.
2. Please confirm with SWPM which level security requirements this project need meet. Then execute related command.
3. Must cover home and pro
4. Must cover all supported TPM module

23.1 For CN image, navigate to Setting->Privacy & security->Windows Security->Device security->select "core isolation details" under Core isolation, set Memory integrity to On. Restart if prompted.


Note: From Win11 24H2, skip this step.

Memory integrity is On after reboot.

23.2 Copy SCPC self-verification Tool to test unit.

23.3 Run tool in PowerShell (Administrator) command window.


Note: For SKUs which memery size <= 4G, the default setting of memory integrity is off. For this case, before tool running, please set memory integrity to on firstly.

23.3.1
1. Add security level to command line.
For project which support level 2, add the parameter"-L2". And the same, for support level 3 project add the parameter"-L3".
Sample command: ".\securedcorepcverifier -L2" or " .\securedcorepcverifier -L3"


2. For all devices with accessible m.2 slots or USB4 ports or Thunderbolt ports, add "-d" to command line.
Sample command: ".\securedcorepcverifier -L2 -d" or " .\securedcorepcverifier -L3 -d"

Expect Result:
"Secured-core PC Tests: PASS"

23.3.2 Since Win11 23H2, if the project support Windows Hello, please execute this step to check the security biometrics enable, others skip.
Run tool again without add security level. Sample command: ".\securedcorepcverifier"

23.3.3 Check the result in "Additional (optional) security information for Client devices only: Secure Biometrics" section.
The results after "Secure Biometrics" is which option your project supported.
For example: "Secure Biometrics - Face & FPR -" means your project supported Face & FPR.

Ensure all supported options' results are "TRUE".


For example, project that supported Face & FPR need show as follow:
"Secure Biometrics-Face & FPR-Are SDEV table and reg key present?: TRUE"
or
"Secure Biometrics - Face & FPR -
Are Face SDEV table and FPR reg key present: TRUE"


Note: For different version SCPC tool, the resulting statements may difference. However, the result must be "TRUE".

23.4 Copy ESSTool to test unit then run it in PowerShell(Administrator) command window.
Sample command line:.\ESSTool.cmd -diagnose


Note:
1. If your project doesn't support Windows Hello, skip this step.

Ensure the result display: ESS is available

23.5 For CN image, reset Memory integrity to Off. Restart if prompted.


Note: From Win11 24H2, skip this step.

Memory integrity is back to default status.

24. Virtual Machine Platform status check

24.1 From Win11 22H2, for EN image, open control panel-->Programs-->Programs and Features-->Turn Windows features on or off.
Check “Virtual Machine Platform” status.

VMP should be enabled.
Note:If VMP is not enabled, please check with SWPM/TPM whether this project meets the minimum hardware requirement for VMP. If not , VMP not enabled is the expected result.

24.2 From Win11 24H2, open control panel-->Programs-->Programs and Features-->Turn Windows features on or off.
Check “Virtual Machine Platform” status.

VMP should be Disabled.

 
Section : RTP (If support) (270) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note:
1. Before test, please contact with SWPM if your project support
2. If support, need cover SACVT tool for this section (test step please follow "Smart App Control test" section)

1. If the project supports RTP, please preload image with RTP module (Add the RTP module manually on preload guidance, RTP Root:“WinB-EnterprisePreloadTrigger”,  RTP Module Name: M9DENT*** ).


Note: The detail module name, please look for it in your SWlist.

2. Ask for the latest RTP SPEC from SWPM, follow the "Included in RTP Preload" requreiment in the SPEC to check the APP installed or not and the version is same as the one in the standard preload( The required APP must be installed correctly on the preload ,the not requried APP can't be installed on the preload).
For "MS Inbox Applications", please ask SWPM to provide the SPEC to check the preload is meet the SPEC or not.


Note: Must cover all supported apps.

 
Section : Direct Storage(If support) (60) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note:Please confirm with SWPM whether this project support direct storage. If supported, execute following steps. Otherwise, skip this section.

1. Make sure McAfee/Lenovo PC Manager version is the same with SW list.

2. Bypassio Compatibility test

This test need Win11 inbox test tool "Fsutil".

2.1 Launch Command(CMD) as administrator.

2.2 Input command line: manage-bde -status, then check and record the value of "Conversion status" for every volume

2.3 Input command line: fsutil bypassio state [target volume]
e.q: fsutil bypassio state D:


Please cover all Non-hiding volume. Just like C:, D:,E:……

If Conversion status = "Fully Decrypted"


Expected result:
Bypassio on "[target volumn]" is currently supported
Storage Type: NVMe
Storage Driver: Bypassio Compatible
***************************************
If Conversion status = "Encryption in Progress"


Expected result:
Bypassio on "[target volumn]" is partially supported
Storage Type: NVMe
Storage Driver: Bypassio Compatible
**************************************
If Conversion status = "Fully Encrypted" or Conversion status = "Use space only Encrypted"


Expected result:
Volume stack bypass is disabled (fvevol.sys)
Bypassio on "[target volumn]" is partially supported
Storage Type: NVMe
Storage Driver: Bypassio Compatible


Else: Please key issue at TDMS.


*Note: Storage Type based on pratice.

 
Section : Product Key Channel check (30) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note: 1.This test need to be executed at the beginning of the SIT phase, if the OS core is not upgraded, you only need to test it once in SIT phase. 2.Execute this test when the OS core of the project preload is upgraded(such as 20H1->20H2,20H2->Win11). 3.Cover all OS SKUS(such as pro,home,S preload) supported on the project.(support OS sku follow SWOD from SWPM)

1 Open File Explorer->View->Enable Hidden items->Go to C:\Windows->Open "modules.log", search for "BAD RETURN".
Make sure that "BAD RETURN" cannot be searched in "modules.log".
 
Section : WinRE (30) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :
1. WinRE State
1.1 The Windows RE status should be enabled.
1.2 Right click "Command Prompt" ,run as administrator.
The Command prompt is opened.
1.3 Input the command: reagentc /info,Check the Windows RE status is enabled.
2. The WinRE should be bootable.
2.1 Click settings->Update and Security->Recovery,Choose the Advanced Startup and click restart now.
The system restart and enter to the "Choose an option" UI.

2.2 On this UI select “Troubleshoot” -> Advanced Options,and then Click on command prompt.

 It should successfully boot into Windows Recovery Environment.

2.3 In the WinRE environment,make sure the touchpanel function is also keep, if the test unit support touchpanel.

2.4 Plug in the usb keyboard and mouse,make the devices are also work without errors.

 
Section : Lesson learn (120) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note: Before test, please ensure the DUT's Secure Boot setting is enabled.

1.(Only for CN image) Open Disk Management, right click (D:)->Choose Delete Volume -> "Yes". Then right click (C:) -> Choose Extend Volume, follow the prompt to finish extend volume.


Note: This test needs to cover all HDD/SSD/SSHD Source.

Ensure that the D drive can be successfully merged into the C drive, and the system has no abnormalities, such as BSOD, etc.

2. Restart system immediatly.


Note: Please restart system after finished step 1 immediatly.

Ensure system could boot to desktop normally, no BSOD.

2.Click Settings->System->Storage->Advanced storage settings->Disks & volumes.

2.1 Click volume C: ->Properties->Change size. Input a size between Min volume and Max volume.(Such as 102,400/153,600/204,800).

Ensure the volume can be shrinked.
Open "This PC" and "Disk Management", ensure the disk volume is consistent with the change.

2.2 Click "(unallocated)"->Create volume. Input random Label name(Such as E:/F:)->Format.

Ensure the volume can be created.
Open "This PC" and "Disk Management", ensure the disk volume is consistent with the change.

2.3 Click the new create disk->Properties->Delete->Delete volume.

Ensure the volume can be deleted.
Open "This PC" and "Disk Management", ensure the disk volume is consistent with the change.

2.4 Click volume C: ->Properties->Change size. Input the Max volume.

Ensure the volume can be extended.
Open "This PC" and "Disk Management", ensure the disk volume is consistent with the change.

 
Section : Hot Key (180) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :
All supported hot keys functions were worked normally by following project spec.Check Hot Key function(follow project's UX/UI spec.)
1. Fn Key
2. CapsLock/ScrollLock / NumLock

3. Rotation lock on/off and corresponding OSD

Follow project's UI/UX SPEC

4. Others Key(HW/SW Keys)

5. Run Sleep/S4/Shutdown/Reboot, make sure that functionality of the buttons and function keys are normal.

6. "Copilot" key function check


Note:
1. For project which support "Copilot" key need check its function
2. Before test, please confirm with BIOS/EC whether it is ready

Refer to "Copilot Market Availability"("App & Drivers UI check" section step1) to confirm whether on current image support Copilot. If support, press "Copilot" key, it will wake up "Copilot". Otherwise, it will call search function.

7. copilotkeytestapp test
Note: For project which support copilot key need cover this test.

7.1 Download and copy copilotkeytestapp to the DUT

7.2 Unzip copilotkeytestapp and open "Readme.md" with notepad

7.3 Follow the steps in "Readme" to long press test for copilot key and "Win+C"

Ensure that the test results are consistent with those described in the "readme"

 
Section : OKR (if support) (60) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note: Before test, please confirm with SWPM if your project support OKR.

1. Copy different kinds of files to desktop,such as movies,musics, documents,installation pakages and so on.

2. Install any apps to the DUT.

3. Restart system.

4. Follow project's design press specified key to enter to OKR UI during the boot process.

5. Select "Backup system", then follow instructions to back up.

6. After finished backup, click "OK" to return to OKR main UI.

7.  Select "Restore system"->"Factory backup", click "Restore"

8. Follow instructions to restore factory.

9. After finished factory restore, click "OK" to return to OKR main UI.

10. Click the button in upper right corner of the screen to restart.

11. OOBE page will shown.

12. Press Shift+F10/Fn+Shift+F10 to invoke cmd.

13. Input "Shutdown -r" in cmd window to restart.

14. During restarting, press specified key to enter to OKR UI again.

15. Select "Restore system", then select a backup which you backup in previous steps to retore.

16. After finished restore, click "OK" to return to OKR main UI.

17. Click the button in upper right corner of the screen to restart.

18. After system boot to desktop, check the copied files and installed app.

Make sure all the files you copied and apps you installed in previous steps except in disk D: had been restored.
Note: OKR only could retore files and apps which copied/installed in system disk.

 
Section : PBR & Recover (240) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note: Please test this section with internet.

1. Recovery from restore point

1.1 Open Control panel->"Recovery"->"Configure System Restore"->Create a restore point named "Test".

1.2 Shutdown then press NOVO button,it will displays "system recovery"->"Troubleshoot"->"Advanced options"->System restore and restore from previously create restore point.

1.3 After system restore completed, restart the unit.

Make sure System Restore completed successfully and the unit restarts without any exception.

2. PBR from WinRE

2.1 Press NOVO button->"system recovery"->"Troubleshoot"->"Reset your PC"->"Keep my files"->"Cloud download",follow the prompt to start reset.


Note: If support fingerprint, check you can login with your finger before "system recovery"

2.2 (If support fingerprint) After system recovery ,make sure we can login the system with your finger.

2.3 Open the Device manager,make sure there is no yellow hang.

2.4 Check Hot Key function(follow project's UX/UI spec),make sure no errors occur.

2.5 Launch all the Apps,especially Lenovo Apps. If support MS PCmanager, teams, need launch them too.

Make sure no errors occur.

2.6 If there's "Lenovo Subscription Marketplace" module in SWlist, check if the icon is normally.

2.7 If "QuickSettingAppLink" module in SWlist, check its function.

Click the Quick Setting icon still could launch vantage normally.

2.8 Open Explorer, check backup folder.

For EN image, there's "Drivers" folder in C:\
For CN image, there's "Drivers" folder in D:\
The backup folder named "DRIVER" or an extra folder "DRIVER" in destination drive is unacceptable.

3. Reset this PC- Keep my files If support fingerprint,Please set fingerprint before test below items.

Make sure you still can login with your set finger after PBR-keep my files.

3.1 Copy different kinds of files to desktop,such as movies,musics, documents,installation pakages and so on.

3.2 Click <Network> on the bottom,choose one of the Wi-Fi,input the passwords and Connect.

3.3 Download the metro apps from the Winstore,and install the third-party programs in the desktop ,such as qq and qq music.

3.4 Start PBR-Refresh:Go to system Settings -> Windows Update -> Advanced options ->Recovery-> Reset this PC, click "Reset PC"-> Choose "Keep my files", click "Next" to Reset .


Or Start PBR under WinRE.

3.5 The interface show:


Additional settings


Current settings:


。Restore apps and settings which came with this PC


。Download and reinstall Windows


Change settings:


Cloud download can use more than 4 GB of data.

Note:
The hint maybe shown as the case example, but not necessarily so. Sometimes it will change by new OS build. Any doubt check with OS team.

3.6 Plug in the AC Click "Next" and follow the prompt to start refresh.

Make sure the system can refresh without errors.

3.7 Check all your personal files which you have copied to desktop will be kept.

3.8 Check the wireless which you have connected before can be connected again without password required.

3.9 Check the metro app the desktop app which you have installed will be removed.

3.10 Open the Device manager,make sure there is no yellow hang.

3.11 Check Hot Key function(follow project's UX/UI spec),make sure no errors occur.

3.12 2.5 Launch all the Apps,especially Lenovo Apps. If support MS PCmanager, teams, need launch them too.

Make sure no errors occur.

3.13 If there's "Lenovo Subscription Marketplace" module in SWlist, check if the icon is normally.

3.14 If "QuickSettingAppLink" module in SWlist, check its function.

Click the Quick Setting icon still could launch vantage normally.

3.15 Open Explorer, check backup folder.

For EN image, there's "Drivers" folder in C:\
For CN image, there's "Drivers" folder in D:\
The backup folder named "DRIVER" or an extra folder "DRIVER" in destination drive is unacceptable.

3.16 Right click "Command Prompt" ,run as administrator.Input the command: reagentc /info,Check the Windows RE status is enabled.

4. Reset this PC- Remove everything (If support fingerprint,Please set fingerprint before test below items.)

Make sure you will can't login with your set finger after PBR-Remove everything.

4.1 Copy different kinds of files to desktop,such as movies,music, documents,installation packages and so on

4.2 Click <Network> on the bottom,choose one of the Wi-Fi,input the passwords and Connect.

4.3 Download the metro apps from the Winstore,and install the third-party programs in the desktop ,such as qq and qq music.

4.4 Start PBR-Reset:Go to system Settings -> Windows Update ->Advanced options->Recovery options-> Reset this PC, click "Reset PC, " Choose "Remove everything", click "Change settings",then turn "Clean data" to ON, Then click "Confirm".

Note:
Different OS build maybe shown different hint. Anyway, you could follow prompt step by step to do.

4.5 Click "Next" and follow the prompt to start reset.

4.6 Plug in AC and begin to reset.

4.7 Check all your personal files which you have copied to the desktop will be removed.

4.8 Check the metro app the desktop app which you have installed will be removed.

4.9 For EN image, check the wireless isn't connected.

4.10 Open the Device manager,make sure there is no yellow hang.

4.11 Check Hot Key function(follow project's UX/UI spec),make sure no errors occur.

4.12 Launch all the Apps,especially Lenovo Apps. If support MS PCmanager, teams, need launch them too.

Make sure no errors occur.

4.13 If there's "Lenovo Subscription Marketplace" module in SWlist, check if the icon is normally.

4.14 If "QuickSettingAppLink" module in SWlist, check its function.

Click the Quick Setting icon still could launch vantage normally.

4.15 Open Explorer, check backup folder.

For EN image, there's "Drivers" folder in C:\
For CN image, there's "Drivers" folder in D:\
The backup folder named "DRIVER" or an extra folder "DRIVER" in destination drive is unacceptable.

4.16 Right click "Command Prompt" ,run as administrator.Input the command: reagentc /info,Check the Windows RE status is enabled.

4.17 If there is "Power Plan for FN+Q 4.0" module in Swlist, you need to execute the following test:
1. For CN image, open power option,there should have four power plan: "平衡","安静模式","均衡模式","野兽模式",make sure the default power plan is "均衡模式".
For EN image, open power option, there should have four power plan: "Balanced", "Legion Performance Mode","Legion Balance Mode","Legion Quiet Mode", make sure the default power plan is "Legion Balance Mode".
2. Use the FN+Q key combination to switch the three modes.

1.Ensure that the displayed language matches the current system language. 2.Make sure that the FN+Q adjustment mode is synchronized with the power plan mode.

5. Win11 Bare Metal Recovery

Copy the recovery partition to the USB media and then recover system when has troubleshoot problems with your PC(Even if it can't start).

5.1 Before testing,download desktop/metro apps,Copy files to the desktop,Connect to wireless with internet.

5.2 Plug in an removable USB media,which must be at least 16GB.

Everything on the Usb media will be deleted.

5.3 Create a recovery drive: Run C:\Windows\system32\RecoveryDrive.exe,Or open the "Control Panel”(View by "Large icons"-> Click "Recovery"->Click "Create a recovery drive",Click "Next",and then click "Next" in Select the USB flash driver interface,Click "Create".


Note: Bare Metal backup only support less than 32GB. If create backup drive fails due to backup system files more than 32GB, please ignore it and skip Bare Metal recovery.
Details refer to Unable to create a recovery drive with a 32GB or 64GB USB drive - Microsoft Community

Make sure Copy the recovery partition successfully.

5.4 Recover system:Shutdown system and Boot from USB media

5.5 Choose language and Keyboard layout,Then click “Recover from a drive”, Choose "Just remove my files", Click "Recover" in the Reset your PC interface,and then click Next.

Make sure begin to reset the system and no errors occur.

5.6 Check all the files & APPs & setting which you copied & installed & set have been removed.

Make sure no errors occur.

5.7 Open the Device manager,make sure there is no yellow hang.

5.8 Check the PBR-Reset function are also OK.

5.9 Check Fn hotkey function(follow project's UX/UI spec),make sure no errors occur.

5.10 Launch all the Apps,especially Lenovo Apps. If support MS PCmanager, teams, need launch them too.

Make sure no errors occur.

5.11 If there's "Lenovo Subscription Marketplace" module in SWlist, check if the icon is normally.

5.12 If "QuickSettingAppLink" module in SWlist, check its function.

Click the Quick Setting icon still could launch vantage normally.

6. For Tablet Project(No novo button),Check windows recovery function.

Note: Copy 2G files to C partition then run PBR .

6.1 Shutdown and then press power on + Volume Up button to enter the NOVO menu interface.

Make sure the NOVO menu displays correct.

6.2 Click windows recovery and then choose "See advanced repair options"->"Troubleshoot"->choose "reset your PC"->Click "Next"->Choose "Only the drive where windows is installed"(if has the interface)->Choose "Just remove my files"->Click "Reset".

Make sure the system begin to reset your PC.

7. Advanced boot testing.

7.1 "Settings"-> "Update&recovery->Recovery"->choose "Advanced startup"->"Troubleshoot"->"Advanced options"->"Startup Settings"->click "restart",The system enter to "Startup settings" interface.

7.2 Choose "(4) Enable Safe Mode" to enter to Safe mode.

Can boot into safe mode successfully and boot into normal system successfully after exit safe mode.

 
Section : Connected System Recovery(If support) (180) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note:
1. Please confirm with SWPM whether this project support CSR.
2. Before test, please confirm with BIOS team whether BIOS is ready.
3. Please cover all WIFI module which project support(for project which not support Wlan, please use lan to recover).
4. Test this section with internet with MS account.

Connected System Recovery (CSR) is new recovery feature for devices shipping with Win11 22H2. User can initiate full device recovery from UEFI, include OS, drivers, applications and so on. 

Recovery over Wi-Fi

1. Before testing, download and install UWP/ Win32 apps, copy files to the desktop, connect to wireless with internet.

2. Go to BIOS setup ->  security tab, set Secure Boot: Enabled, save and exit. Go to BIOS setup -> Configuration tab -> Network Boot Settings, set UEFI Wi-Fi Network Boot: Enabled, Reinstall Windows from cloud: Enabled. 

3. Reboot, enter boot menu, choice Reinstall Windows from Cloud.
Note: How to enter boot menu, please follow your project.

Ensure Reinstall Windows from cloud is listed.

4. Check the confirmation window, select Agree, the CSR process starts. 

The confirmation window shows up and has no error or truncation.

5. The Wi-Fi Networks page shows up. Choose a wireless network, input the password and connect. 

The connect process has no error.

6. Wait for the download and recovery process to complete automatically.

Make sure the system starts to recovery and no errors occur.
OOBE screen is displayed after recovery.

7. OOBE to desktop.


Note:
1. CSR does not support retaining custom Start menu layout(Contains desktop, taskbar, pinned and recommend area layout).
2. For Single language image, after CSR there's additional language in OOBE is not an issue. It's by design.

8. Check the OS Build by win+r -> winver.

The OS Build is the latest revision of the pre-installed Version. (e.g., If the device was pre-installed with Win11 22H2, the OS Build should be 22621.xxx, where xxx is the latest available revision of 22621)

9. Check that all apps/ files/ settings you installed/ copied/ set have been removed.

Make sure no errors occur.

10. Refer to SWlist, check that the apps listed as Metro and available in the Microsoft Store are restored.
Note: 1. Desktop apps will not be restored.
2. Please search the app with actual app name, for example "AI Meeting Manager" in SWlist could be find as "智能会议助手“ in Microsoft Store.

The app version is the same or later than SWlist.

11. Launch all apps, especially Lenovo apps, make sure no errors occur.

12. Open the Device manager, make sure there is no yellow hang.

13. Refer to SWlist, check the drivers are restored, except for drivers without Device ID and hardware support apps (e.g. RTK console, AMD Radeon…)

The driver version is the same or later than SWlist. 

14. Check hotkey function (follow project's UX/UI spec), make sure no errors occur.

 
Section : Basic Function Test(test this section after PBR) (360) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Notice:
1. Check this section after GM0. In another word, before GM0, you could skip this section.
2. Test this section with internet.

Note:
1. Please use 2nd administrator account to test this section.
You should create a 2nd account then change the account type to administrator.
For different OS version, the operate path maybe different. You should follow the instructions to complete the setup step by step.
eg: Open Settings-> Accounts-> Other users-> Add account, then expand the account, click "Change account type", change the account type to "Administrator".
2. If has dock, please plug in the dock to test the following test. (If has wigig dock, need to plug in)

Ensure can sign in the 2nd account and without any errors.

1. Press "Win+X" to check device manger when the first boot in.

Ensure all devices don't have yellow bang in device manager.

2. Window hello & Finger printer setting (If support)

2.1 Open All settings-->Accounts-->Sign-in options, add account password and then add pin.

2.2 If your test units support finger printer, ensure register your fingerprinter is successful.

2.3 If your test units support windows hello, ensure register your face by IR camera is successful.

When enrolling, should be able to see preview of the normal color image. Setup should complete within 30s. Ensure it can register successfully.

3. Multi-media playback function check

3.1 Playing the online video after connected to wireless.

Ensure Wi-Fi can connect, video and sound playback is normal

3.2 Mute/ Volume Down/ Volume Up

Ensure the function is correct.

3.3 Plug in the external display by VGA or HDMI or Type-C dongle, then press hotkey to adjust the display Mode, ensure the display has no error.

Ensure the display has no error.

3.4 Play online video about 5min then launch several applications, such as WordPad, paint, windows photo gallery…

Check displays no lag or hang up

4. Function check after PM

 Note: All test need cover AC mode and DC mode

4.1 Fuction check after resume from MS/S3

5.1.1 Put unit into MS/S3 by close lid

Ensure uint could into MS/S3 successfully

4.1.2 Open lid and resume.

1.Ensure can boot to OS by Window hello or fingerprinter(If support)
2.Ensure the Wi-Fi is connected and external monitor display normally.
3.System can standby, and all devices and APPs are OK when resume.

4.2 Function check after reboot

4.2.1 Reboot the system and make sure can boot to OS by Window hello or fingerprinter(If support)

4.2.2 Check if system can access Internet by Lan cable after reboot.

4.2.3 Connect the BT headphone, then play the online music.

Ensure the sound can be output from BT headphone.

4.2.4 Open the windows camera and check camera works without any error.

Disabled/Enabled camera, make sure no error.

4.2.5 Open notepad or word, then press all key on the keyboard.

Ensure the keyboard output is as expected.

4.2.6 Press F1~F12 and check the hot key's function is OK.

Note: For some projects need press Fn + F1~F12 to check the hot key's function.

4.3 Function check after hibernate

4.3.1 Click battery icon then choose "More power options"->Click "Choose what closing the lid does"->Click "Change settings that are currently unavailable"->Check "Hibernate"

4.3.2 Set power button action to hibernate in Power Management. Launch several applications, such as WordPad, paint, windows photo gallery

4.3.3 Pressing power button and resume.

1.System can hibernate, and all devices and APPs are OK when resume.
2. Ensure it can boot to OS by Window hello or fingerprinter(If support).

4.3.4 Insert a Media Card in card slot (If support), ensure Can detect the device.

Ensure can read/delete/copy/compare files from the Card.

4.3.5 Right click Win icon select Disk management, then right click C: disk and chose shrink Volume -> Create new partition.

New partition can be created.

4.3.6 Right-click the newly created disk volume then select Delete Volume -> Extend volume.

Volume can be deleted and extend.

4.3.7 Check touchpad Tap, cursor moving, scrolling, pinch, rotate function

Ensure touchpad function is ok and all gesture can work.

4.3.8 If machine support touchscreen, drag or double click icon on desktop.

Ensure the icon can be moved or opened.

4.3.9 If machine support pen, open the Drawing tool, such as "Paint", use pen check point ,line and arcs function.

Ensure the panel no errors.

4.4 Function check after shutdown

4.4.1 Shutdown system, then plug in AC adapter.

Ensure charge LED light

4.4.2 In Shutdown mode, Plug-out AC.

Ensure charge LED off.

4.4.3 If project support "flip to boot function", first close the lid and then open it.

1.Ensure test unit will power on automatically in one second.
2. Ensure it can boot to OS by Window hello or fingerprinter(If support).

4.4.4 If project support WWAN, insert a SIM card(supported), connect to the Internet via a mobile network.

Ensure surfing the internet successfully.

4.4.5 If machine support E-ink, close the lid and switch to E-ink interface. Use the supported pen to click the E-ink main UI.

Ensure E-ink main UI functions are ok.

4.4.6 Cover the ALS sensor on the screen with your hand.

Ensure the screen brightness can be turned down 

4.4.7 Turn the machine 180-degrees.

Ensure the screen display can be flipped synchronously

5. Smart feature check

5.1 Zero touch (If support)

Note: Below basic function check Clamshell: keep the lid angle <= 135-degree Yoga: keep the lid angle <=135-degree Folio Case: keep in laptop mode and the angle of the screen and the ground between 90~140degree

5.1.1 Set the "Zero touch login" State to "On" in Lenovo vantage/PC manager/Smart engine ->Then set face recognition in Lenovo vantage/PC manager(you should set the password and pin first)

Ensure the "Zero touch login" state can be set successfully; Ensure the "Manual detection sensitivity " is activated at the same time Ensure face recognition can be set successfully

5.1.2 Reboot the system and move the face in front of the camera.

Make sure it can login successfully.

5.1.3 Put the system into sleep by manual (Power button/Win+X)->Stay in the front of unit for 2 min

Make sure the system can go to sleep successfully and system will keep on sleep.

5.1.4 Let people go away from the unit->Let people go back to unit after 2 min and check the system if can be waked up to desktop automatically

The system should can be waked up and login successfully; Ensure the wake-up time <2s

5.2 Smart keyboard backlight function (If support)
      Keyboard backlight default setting check

5.2.1 Put test unit into black lighting condition

Ensure the keyboard backlight can auto turn on and at the high brightness

5.2.2 Put test unit into bright Lighting condition again.

Ensure the keyboard backlight can auto turn off

5.2.3 Switch the keyboard backlight to Low mode by Fn + Space

Ensure it will show "Low" OSD; The keyboard backlight is on and at the low brightness

5.2.4  Switch the keyboard backlight to High mode by Fn + Space

Ensure it will show "High" OSD; The keyboard backlight is on and at the high brightness

5.2.5 Switch the keyboard backlight to Off mode by Fn + Space

Ensure it will show "Off" OSD; The keyboard backlight is off

5.2.6 Switch the keyboard backlight to Auto mode by Fn + Space

Ensure it will show "Auto" OSD

 
Section : NLS image download and test (30) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note: This section's test need from GM0, and only test images which need to be shipped. 

1.Make sure all NLS images can be downloaded.(Download action should be done by preload team, preload test just need to confirm the result with preload team by mail.)

Note :If has PRO(Preload Release Optimization) Or SMPT can cover,please use it.

2.For Russia image,you need to check the following two points on "Protect your device" page in OOBE.   


1.Make sure "Lenovo may share my email address with McAfee to register my anti-virus security suite(Not applicable to Russia Federation) is unchecked.
2.Make sure "(Not applicable to Russia Federation)" exist in Russian. Details you can refer to attachment "OOBE check point for Russia image".

3.For Russia image, follow the requirement in the SW list, check all the APP preinstalled or not,and check applications' version is right or not.

Following the requirement in the SW list,Check all the APP preinstalled or not,and check applications' version is right or not.

4. For Russia image, connect to the network, then open "Yandex browser". Make sure it can be launched normally, the default behavior and homepage follow attachment "Yandex browser default homepage check steps20220822.docx".

 
Section : Retail Demo Experience Test (30) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note: Test this section with internet.

1. Enter to Retail Mode, Connect to the internet.Choose Settings-> Update & Security ->Activation,Click the "Windows" 5 times,It will pop up the tips "Change to retail demo",Choose "Change"->"Next"-->"Finished" .


Note: If click "Next" need input "Retail access code", you can click "Skip".

Make sure can enter to retail mode(you can check the account)

2. Exit retail mode, Choose Settings-> Update & Security ->Activation,Click the "Windows" 5 times,It will pop up the Interface.choose "Advanced configuration"->Choose "Remove" in remove RDX.

 
Section : JS Performance Test (30) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note: If the updated content in Preload is required to test JS performance, then you don't need to execute this test, just confirm the result.

Each Preload which is later than the golden preload(SIT close sign off preload),Need to cover the JS Performance test.

1. Please test with "JS performance test case".(All the requirements please follow the JS performance case requirement,such as test Skus...)

 
Section : 1h quiet time test (60) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note:
1. As OPD requirement, applications which present UI must not auto-launch post OOBE, for a period of 1 hour.
2. Please execute this test as soon as OOBE is completed.

1.Repeat the steps in “Preparation”,"Preload","MS OOBE-step1~6" section.

Make sure no error occurs.


Note:Because this test needs to be performed immediately after OOBE enters the desktop, it needs to preload again.

2.After OOBE completed, enter to the desktop, copy the "WinSpy" tool to the desktop.

3.Follow the attachment "WinSpy SOP" to execute test.

4. After tool finished running, pack all the screenshots and the tool log into a compressed package and mail to SWPM to check if these screenshots cause by which apps could waiver. For system apps, please ignore.
If couldn't waiver, open an issue on TDMS,  must upload the compressed package and the final mail as test logs in this test case.


Note: To save the tool log, please execute WinSpy.exe in PowerShell/CMD as administrator, and typing: .\WinSpy.exe >> WinSpy.log

 
Section : Installation & Uninstallation (720) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note:
1. Please test this section without internet.
2. Before test, please turn on SAC firstly.
3. For uninstallation, all drivers and apps need to be uninstalled regardless of whether there is a backup. All drivers/apps only contain 3rd-party drivers/apps, inbox drivers/apps no need to be uninstalled.
4. For installation, projects which have "Drivers"/"Applications" backup folder, only need to be installed drivers/apps which in the backup folder. Projects no backup "Drivers"/"Applications" in the system, no need to be installed.
5. For S mode, no need to execute this section

Turn on SAC method:
Open Settings->Privacy & security->Windows Security->App & browser control->Smart App Control settings, select "on" to turn this feature on.

1. Uninstall all the drivers and APPs, make sure all apps and drivers can uninstalled successfully.

1. Unstallation process no interrupt, no error.
2. Any block due to SAC, please close WU, connect internet, waiting 30 minutes then disconnect internet and uninstall again(Close WU steps refer to "smart app control test" section).
If this time uninstall pass by SAC library update, it is acceptable, else create issue on TDMS, set serverity to 2.

2. Install all drivers and APPs from "D:\drivers" and "D:\application", check all drivers and apps can be installed successfully.

1. There should be clear executable files in every driver's folder.
2. Installation process no interrupt, no error.
3. Any blocke due to SAC, treament refer to uninstallation.

 
Section : Lag & System Resource Utilization Check (90) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note:
1. Use local account without internet to test step 5.10 and MS account log in to test other steps.
2. Need cover CN&EN.

1. Lag verification
Note: Please execute following steps within 2 minutes at the end of OOBE.

1.1 Launch “Settings”, then execute following operations: Switch tab, click any option, typing any words in settings search bar, close “Settings”

1.2 Launch “Edge”, then create new tab, typing any words in address bar, switch tab, close “Edge”

1.3 Launch “Explorer”, then click or double click any drive or folder, create new tab, typing any words in address bar, close “Explorer”

1.4 Launch “Camera” from search bar, then take photo, switch to video, view preview UI if has delay, close “Camera”

1.5 Launch “Task manager”, look for any anomalies

1.6 Repeat step1.1- step1.5 four times


Note: Please finished step1.1- step1.5(1 round test) within 30S

1. App content loading < 2S
2. Operation response < 3S
3. Typing no delay

2. Restart

3. Idle 15 mintues

4. Single App's CPU Utilization and memory Usage check

4.1 Open "Task manager"—> "Processes" sheet, check the CPU Utilization and memory Usage.

Confirm single App's
1. CPU Utilization <1%
2. memory Usage <100M


Note:
App scope:
1. App in SWlist
2. Not contains inbox apps and antivirus like PCM, McAfee etc.

5. System resource Usage/Utilization check

5.1 Download HWiNFO tool from following site:


 HWiNFO - Free System Information, Monitoring and Diagnostics

5.2 Install HWiNFO64 then launch it

5.3 Select "Sensors-only" and click "Start"

5.4 Let HWiNFO monitor 1 minute, then check following items

5.5 CPU Utility check


Look for item "Total CPU Utility" and check its Average value

Ensure the Average value of "Total CPU Utility" <5%

5.6 Open "Task manager"—> "Performance" sheet

5.7 NPU Utilization check


Click NPU0 and view 1 minute

Ensure the NPU Utilization is 0%

5.8 GPU Utilization check

5.8.1 Click GPU0(IGPU) and view 1 minute

Ensure the GPU Utilization <5%(Instantaneous Utilization >5%, please ignore)

5.8.2 Click GPU1(DGPU, if has) and view 1 minute

Ensure the GPU Utilization is 0%

5.9 Disconnect internet then restart.

5.10 Memory Usage Check
Note: For this part, steps and SPEC from case Name: Memory Enhance Function.
If any difference, please refer to the latest version of this case.

5.10.1 Open "Task manager"—> "Performance" sheet.

5.10.2 Idle 15 mins, make sure there is no any usage peak show on the graph. 

5.10.3 Collect data and compare with Spec which divided by screen resolution and ram size. 

Base on Microsoft clarify for 24H2 OS: Add 0.6GB gap for 24H2 OS based on below SPEC:
For 16G and below RAM size, ensure usage <= 3.3GB on FHD and below panel SKU;
For 16G and below RAM size, ensure usage <= 3.8GB on UHD and irregular resolution panel SKU;
For 24G RAM size SKU, ensure usage <= 4.0GB;
For 32G RAM size SKU, ensure usage <= 4.5GB;
For 64G RAM size SKU, ensure usage <= 5.0GB.

5.10.4 If there is any high ram usage process / apps, generate task list and locate it then report.

Open cmd with Admin privilege, input “tasklist /FO csv > "%userprofile%\desktop\tasks.csv" and press enter. See csv format file at desktop. 

6. Live Captions resource utilization check


Note:
1. Only Copilot+ PC and Live Captions with traslation need test this part.
2. Only test inbox Live Captions
3. For this part need cover traslation to English and simplified Chinese not EN and CN preload.

6.1 Copy a speech video to DUT and playback it.

6.2 Typing "Live Captions" in search bar to launch it.

6.3 Follow instructions enable its function.

6.4 Launch "Task Manager"-> "Processes", check the memory usage of "Live Captions".

Ensure the memory usage < 500M.

6.5 Switch to "Performance" ->"NPU 0", check the NPU usage.

Ensure during "Live Captions" working, the NPU usage < 15%

6.6 Close "Live Captions" then check the usage of memory and NPU again.

Ensure process "Live Captions" had been removed, its memory usage had been released immediately. And NPU usage tend to 0%.

7. Paint-Cocreator resource utilization check


Note:
1. Only Copilot+ PC need test this part.
2. Only test inbox Paint-Cocreator.
3. For this part only test EN preload.

7.1 Connect to internet.

7.2 Launch Paint and login it with your MS account.

7.3 Click "Cocreator" icon and the Cocreator panel will shown.

7.4 Typing theme which you want to create into the input box under "Describe what you'd like to create", then click in the canvas and waiting it create the picture.


Note: During the picture generate, a turn around icon will occure in the "Generated art preview" panel. And you could adjust the "Style" type and "Creativity" rate at the bottom.

7.5 Click sentence "Select to add art to canvas", it will add the picture to the canvas.

7.6 View "Task manager"->"Proccesses", check the memory usage of paint.

Ensure the memory usage always < 1G

7.7 Switch to "Performance" ->"NPU 0", check the NPU usage.

Ensure during picture generation, the NPU usage rate tend to 100% and after finished picture generation it tend to 0%.

7.8 Close "Paint" then check the usage of memory again.

Ensure process "Paint" had been removed, its memory usage had been released immediately.

7.9 Ideal 15 mins then check process "Microsoft.ImageCreation.Private.ImagingHost".

Ensure process the proccess had been removed and its memory usage had been released.

 
Section : Modern Preload test(If support) (960) Attachment :
Workloading : (Min) LeadingTime : (Min) Phase :

Note:
If the project doesn't support Modern preload or the special module(Modern APP/ UDC Driver) of the modern preload has no any update, then the section can be skipped.
For Modern preload Section, test with EN and JP preload image, cover pro and home, must cover each McAfee module individually.

Before preload:
1.Check the right SN and MTM("MT+CTO1WW")and TPM key have been written into the test units.(Tester can ask help from SWPM or bios owner to check or write SN,MTM and TPM into test units).

2.Provide every test unit‘s SN, MTM and TPM key to SWPM to maintain server to build up dummy test environment. 

3.Confirm with SWPM that the dummy test environment is ready for test or not, start modern preload download when test environment is ready.


Attention: If following two modules in the SWlist, need added these two modules manually when download preload.
1) Component Place Holder LGAG1I13A0
2) Startpin Patch for CTO LGAGYT15A0

After Preload:
4.Choose shutdown and then enter to Bios Setup interface,load default(Fn+F9),Saved and then set the bios settings as following: Boot Mode : UEFI Secure Boot : Enabled Intel PTT/AMD PSP :Enabled (If Support)

We must based on MFG ship mode to test the following preload test.

Start menu check

If your SWlist have follow two module as below:
Component Place Holder LGAG1I13A0
Startpin Patch for CTO LGAGYT15A0


You need check if "My software" icon in start menu as follows:
1. If the icon in the first page of "Pinned" area
2. If the icon in "All apps" area

"My software" should appeared in these two locations.

First, you need to confirm the test condition and the test cases which you need to execute according to the "Modern Preload Test Strategy" sheet in the test case "Modern preload Test strategy".

Second, you need to determine whether the modern app type you are testing belongs to "Redemption" or "Installer" according to the "Modern APP Test Strategy" sheet in the test case "Modern preload Test strategy".

1.If the "modern preload type" of the modern app is "Redemption", please execute step1.1-1.2.

1. 1Compare with SW list to check if there is any APP or driver lost or is unnecessary and no modern app installed.Launch all installed APPs and drivers' UI, make sure all APPs and drivers' UI can be launched successfully and without any abnormality.

1.2.Connect to the Internet, launch Lenovo vantage, click "L" icon at the upper right of the main interface of Vantage, check if  "My Software" exists,  click "My software" and then appear My software interface.

Make sure redemption code and 3rd App vendor URL display normally at my software page, click the URL to successfully connect to the official website of the third-party software.

2.If the “”modern preload type“” of the modern app is "Installer", please execute step2.1-2.6.

2.1Compare with SW list to check if there is any APP or driver lost or is unnecessary and no modern app installed.

2.2.Connect to the Internet, launch Lenovo vantage, install the modern app at my software page in Vantage.

Make sure the modern app can be downloaded and installed successfully ,and the name and version of the app should match the Swlist.

2.3.Launch all installed APPs and drivers' UI, make sure all APPs and drivers' UI can be launched successfully and without any abnormality.

2.4.Uninstall the modern app from "control panel"->“Uninstall a program", make sure the modern app can be uninstalled successfully.

2.5.Excute  PBR- Keep my files, make sure PBR completes successfully without any exceptions.

2.6.Install the modern app in Vantage again,make sure it can be downloaded and installed successfully and the name and version of the app match the Swlist.

A7N1625S01 A7N3225S02 A7N3225S03 A9N1625S04 A9N3225S05 A9N6425S06

     *Test Units Preparation : (Min)      Please input 0 if no test units prepare.
     *Multiple testers Percentage : Add
Tester Percentage(%)
History log
Test log
  
Section/Step Test Log
Test log is mandatory.
Section Test Case Item A7N1625S01 A7N3225S02 A7N3225S03 A9N1625S04 A9N3225S05 A9N6425S06
Smart APP Control test

3. The tool will create a zip file in the .\Results directory. This zip file will contain an HTML report of the test results, as well as a child folder containing collateral log files from the tool execution.


Important: It is not possible for a tool to scan a Windows image and determine with complete certainty that all files are properly signed. This is because executables can be embedded within other files or loaded from external sources. (From “MDA Smart App Control Validation Toolkit Guidance” Version 2023.02.01.0 RTM)

Upload Upload Upload Upload Upload Upload
1h quiet time test

4. After tool finished running, pack all the screenshots and the tool log into a compressed package and mail to SWPM to check if these screenshots cause by which apps could waiver. For system apps, please ignore.
If couldn't waiver, open an issue on TDMS,  must upload the compressed package and the final mail as test logs in this test case.


Note: To save the tool log, please execute WinSpy.exe in PowerShell/CMD as administrator, and typing: .\WinSpy.exe >> WinSpy.log

Upload Upload Upload Upload Upload Upload
Defect list

     
     
Product SKU Test Unit
 

Copyright(c) 2010-2012 by Lenovo. All rights reserved